Concept
dynamic programming
Parents
Children
7.4K
Publications
428.6K
Citations
14.9K
Authors
3.1K
Institutions
Differential Dynamic Programming
1968 - 1976
The period foregrounded differential and decomposed dynamic programming for high-dimensional and continuous-state problems, with block decomposition and embedded state-space reductions dramatically extending memory efficiency and problem size. Dynamic programming was applied to capital budgeting, inventory planning, and production scheduling, linking sequential decisions to horizon planning and capital expenditure sequencing across domains. Extensions to differential/continuous dynamic programming and nonstandard objective structures enriched continuous-time decision problems and provided robust, convergent policy computation.
• Dimensionality reduction and memory efficiency emerged as core themes in DP, with decomposition into blocks, embedded state-space reductions, and resource-focused analyses enabling larger problems, particularly in water resources and high‑dimensional settings [4], [11], [17], [13].
• Dynamic programming was applied to capital budgeting, inventory planning, and production scheduling, linking DP to budget constraints, horizon planning, and capital expenditure sequencing across diverse domains [2], [9], [18], [15], [3].
• Differential/continuous DP and optimal control innovations extended DP to continuous-time decision problems, introducing differential DP and higher‑order algorithms for robust, convergent policy computation [7], [16], [6].
• State-space analytic formulations and nonstandard objective structures (reward operators, preferences, linear decision rules) broaden DP beyond classic value iteration, enabling analytic/reward-based updates and rule-based decision models [19], [20], [10], [14].
Decomposable Dynamic Programming
1977 - 1983
Uncertainty-Aware Structured Dynamic Programming
1984 - 1990
Near-Linear Time Dynamic Programming
1991 - 1997
ALP-Based Dynamic Programming Framework
1998 - 2004
Adaptive Approximate Dynamic Programming
2005 - 2011
Convergent Adaptive Dynamic Programming
2012 - 2018
Robust Adaptive Dynamic Programming
2019 - 2023